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ln the ordinary theory of optimal control (LQR and Kalman Filter), 
Inc variances cl' the actuators and the sensors are assumed to be known ( not 
related to the capacities of the devices). This assumption is not true in practice. 
Generally , a device with greater capacity to exert actuating forces and a sensor 
capable of sensing greater sensing range will generate noise of greater power 
socctral density. 

When the ordinary theory of optimal control is used to estimate die 
errrors of the outputs in such cases it will lead to faulty results, because the 
capacities of such devices are unknown before the system is designed. The 
performance of the system designed by the ordinary theory will not be optimal 
as the variances of the sensors and the actuators are neither known nor con 
slant. The interaction between the control system and structure could be serious 
because the ordinary method will lead to greater feedback (Kalman gain) 
matrices. 

The ma n purpose of this paper is to dvelop methods which can 
oplimi?e the performance of systems when noises of the actuators and the 
sensors are related to their capacities. These methods will result in smaller 
feedback ( Kalman gain) matrix. The smaller matrices will reduce the interac- 
tion between the control system and system structure and, thereby, reducing die 
requirements on the structures and consequently making the structure more 
flexible. 


INTRODUCTION 

In the optimal control of stochastic systems, we ordinarily assume that 
noises of the actuators and the sensors arc not related to the capacity of the 
cClutors and sensors] 1,2,3 1 This assumption is not true in practice. Generally, 
the variances of actuators and the sensors, especially the actuators , are related 
to the capacities of the devices. Obviously, a fuel jet capable of generating a 
force of 1 00 lbs will have greater noises than the one capable of generating a 
force of 1 Hi. It will be realistic and practical to assume that the noise variance 
cT the actuators and the sensors be linear function of the variance of the con- 
trolling forces and the output of the sensors i.e., the observations. Under this 
assumption when a device is required to have greater capacity it will also intro- 
duce greater noise. The ordinary method of optimal control problems have at 
least three defects 

(a) It is hard to specify correctly the noise power spectral densities 
of the actuator and the sensor because the capacities of these devices are tin 
known 

* Graduate Student, Dept, of Mechanical Engr., Howard Umv., Washington, 
D.C. 20059,+ Assoc. Professor, Dept, of Electrical Engineering. Howatd IJniv. 

23 


VftVB 


PRt'CtDiiiG PAGE 3LANX NOT FILMED 



before the system .s designed 

(b) The resultant feedback and Kalman gain matrices may not be 
optimal when the noises in these devices are not related to their capacities. 
Therefore, the performance of the control system may not be as good as it 
would be otherwise. 

(c) When the noises are assumed to be not related to the capacities 
of the devices, the resultant feedback and Kalman gain matrices will be large, 
making (he interaction between control system and the structure unsafc[4]. 

Because of these defects, it is hard for us to estimate the errors of 
t ic outputs. The errors of the outputs will be large, and the interaction between 
the control system and system structures will produce large errors. 

In some control systems, such as communications satellite and on-or- 
bit telescope, the precision of the control system is critical, and in the future 
missions their structures could be very flexible. The variances of these devices 
will be assumed to be linear functions of their capacities. 

In this paper, we will develop methods which will optimize the per- 
formance of systems when noises of the actuators and the sensors arc related to 
their capacities. The feedback (and Kalman gain) matrices arc found by this 
methods will be automatically smaller than those found by ordinary methods. 
Therefore, the interaction between the control system and the slrurcturc will be 
reduced and thereby, permitting more flexible structures. 


II PROBLEM STATEMENT 

Let us I rsl consider the optimal control of a first order system 

( 1 at 

x = ax + u + w ' 

u = - r x M b) 

,= E 

This is a steady-state optimal control problem with exact observation, 
f is the feedback coefficient to be determined, a and r are given parameters. E 
is the mean operator, w is a z,ero mean white Gaussian noise. Unlike (he ordi- 
nary control problem, wc assume that the variance of (he noise w, can be 
described by 
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W = W + a a 

U u 

2 2 

= W 0 + a r a 


where W (| ^ anc j a are non-negalive constants. °"u can be considered as the 
nominal variance of the input, a good measure of the capacity of the ac- 
tuator. From (la) and (lb) , we have 


x = ( a - f )x + w 


(3) 


According to stochastic control theory, the variance of x, denoted by P 
can be determined by 


2(a-f)P + W 

= 0 

(4) 

Since o\ = P , eq.(4) reduces to 



2 ( a - f ) + W 0 + 

2 

a f P = 0 

(5) 

2 

or (2a -- 2 f + a t ) P 

O 

11 

+ 

(M 

Since P must be greater than or equal to 
hold 

zero, the following 

condition 

2a - 2f + a f < 

0 

(7) 

The cost functional can be written as 



J = P + r f 2 P 


(S) 


Using cq.(6 ), we have 


W. 


J = ( 1 + r f ) - 


( 2 f - 2 a - a I ) 


( 9 ) 


The inequality above indicate the stable region for the problem. 
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The stable region for ordinary problem is defined by 

a - f < 0 (10) 

The stable regions describe by equations (7) and (10) are plotted in 
Fig. 1. Obviously, the stable region of the present problem is only a subset of 
the region of the ordinary problem. The stable region becomes smaller when a 
becomes greater and this region is not directly related to the constant term. For 
certain values of a > 0 and a , it is possible that there is no f which lie in the 
stable region, i.e.. such a system can’t be stabilized. 

The optimal feedback control can be found by differentiating 
equaiion (9) with respect to f and equaling the derivative of .1 with respect to f 
to zero. The derivative of J with respect to f after simplification can be 
written in the form 

d J _ 2 Wo 2 

. r 22 ( r f - 2 r a f +a f - 1 ) 

( 2 f - 2 a -a f ) 

Equating the derivative of J to zero and solving the quadratic equa- 
tion in f and neglecting the extraneous solution, we obtain the optimal feedback 
control as follows. 


r 


(a - 2 r 3 ) + 


si ( a - 2 r 


a) 4 


4 r 


2 r 


(11a) 


Figs 2,4 and 6 show the ratio of optimal feedback (the value of f 
given by equation (1 la)) to the feedback found by ordinary method vs. r for 
various values of a and a. We can see that the value of f/fo is less than 1, 
i.e., when the noise of the actuator is capacity related, the optimal feedback 
tends to decrease. The reason for this is that a greater feedback corresponds to 
a greater actuator signal, and increased capacity of the device and increased 
noise power specUal density of the noise. Therefore, a smaller feedback matrix 
wall be preferred. When r becomes smaller, a becomes bigger and a becomes 
greater. The difference between f and f Q will becomes greater. The reason is 
riot hard to imagine. When r becomes smaller, the feedback by the ordinary 
method becomes greater even it is out of the stable region, while the feedback 
by the present method although becomes greater but the increment will not be 
significant because it has not taken the increase in noise power into considera- 
tion, and the feedback will never be out of the stable region. When cx ( alpha) 
becomes greater, noise is more related to the capacity and the system will more 
seriously depend on the feedback. Figs 3,5 and 6 show the ratios of optimal 
cost found by (he propsed method to the case when f is found by the ordinary 
method. Fig. 5 docs not have a plot for a =1. because the feedback found by 
the ordinary method is out of stable region, and the ratios, Jo/J is infinite, 
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IU GENERRAL CASE 

In the above section, we have solved a simple problem by theoretical 
approach. In general system contains multiple slates with multiple inputs and 
multiple outputs, and the mcassurements are corrupted by noises. Then , ihe 
problem can be stated as follows. 


J = E { y o y + u T R u } 

(11 b) 

= H x 

= A x + B u 


u= - F x 
x = A x + B u 


where 

y= Output vector 
x= Stale vector 
u= Control Vector 
7= Measurement Vector 
x= Estimated State Vector 

w= input noise vector (7,ero-mean white Gaussian noise) 
v= Measurement noise vcctor( zero mean white Gaussian 
noise) 

F = Feedback matrix 

K = Kalman Gain Matrix 

and the matrices arc of appropriate dimension 


The noise 

covariance 

matrices arc given by 

E { w 

w } _ 

W 

E { v 

T 

v } = 

V 

The only difference between the ordinary problem and proposed problem 
that the model of the covariance matrices w and v. Ordinarily W and V ;t 
assumed to be constant matrices which are not related to the capacities of I 


+ Gw 


( 12a) 


(12 b) 


+ K ( z - M x ) 


(12. c) 


min 

!•', K 


with constraints 


x 
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actuators and sensors. In Ihis paper W and V arc assumed to be matrices 

whose covariance matrices are functions of the capacities of actuators and 
sensors. 

The capacity of an actuator can be reasonably be represented by the 
nominal varianacc of the actuator signal, 

2 - A ' T T A T 

(T U = E {u 2 } = f E { x x } f = f P - f 
1 i oo i i oo i i x i 

where F is the ith row of F. 

And , we will assume the variance of an actuator to be a linear 
function of its capacities , i.e., 

W = diag { w , , w 2 , w m } 

2 

w. = w + a . cr 

t ! U . 

I 

where w and a. are non-negative constants 
' o 1 

Similarly, 

V = diag { V, . V 2 . V, } 


2 

V - V. + (3 . (T 

1 'o 17 


where V. and (3 . arc non - negative constants 


, 1 I A I 

cr = E | 7 . 1= m.E fx x }m. _ mPm 

ii t t 

where 111 i is the ith row of M. 

Clearly the covarince matrices become functions of the feedback 
and Kalman gain matrices. 

Equation ( 1 2. a ) ,(12. b) and (12. c) can be written as 
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According to the Stochastic Control theory the covariance matrices satisfy the 
following equations 


i 



where W and V arc fractions of ^ x , F and K .To solve the above 

optimization problem, we probably have to use numerical approach 

IV DIRECT APPROACH 

The simplest way to solve the problem is to use direct approach. In 
the direct approach, we assume that ail the elements of F and K are parameters. 
The cost J can be found by solving equation (1 lb) iteratively when F and K are 
given. Various techniques of optimization theory can be used to find the op- 
timum value of F and K. 

However, this method can solve only problems of smaller dimension. 
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For relatively large problems, the number of parameters will be large and the 
computational efforts to find the cost for given F and K will also be largc;lhere- 
fore, the total computational load will be large 

It seeems that the challenging problem here is development of com 
putationally efficient fast algorithm to sove the feedback gain and the Kalman 
gain 
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